Geraint North

Planning to Arm mobile devices with chips that handle AI

ARM is exploring ways to optimize mobile devices for generative AI by developing specialized chips and techniques like model compression, quantization, and flexible hardware architectures. The company is focusing on reducing model sizes, experimenting with different data types, and creating tools that enable efficient AI inference across various computing units like CPUs, GPUs, and NPUs.